REACT Fits to Linear Models and Scatterplots
نویسنده
چکیده
REACT estimators for the mean of a linear model involve three steps: transforming the model to a canonical form that provides an economical representation of the unknown mean vector, estimating the risks of a class of candidate linear shrinkage estimators, and adaptively selecting the candidate estimator that minimizes estimated risk. When the mean vector is smooth, the desired canonical form of the linear model is achieved by constructing a smooth orthogonal basis for the regression space. Such a smooth basis for a complete, balanced one-way layout is asymptotically equivalent to the discrete cosine basis. Applied to one-or higher-way layouts, the REACT method generates automatic scatterplot smoothers that compete well on standard data sets with the best ts obtained by alternative techniques. Historical precursors to REACT include nested model selection, ridge regression, and nested principal component selection for the linear model. However, REACT's insistence on working with an economical basis greatly increases its supereeciency relative to the least squares t. A secondary improvement stems from REACT's use of exible monotone shrinkage rather than 0-1 shrinkage of components. Both improvements are demonstrated numerically on data sets and theoretically through Pinsker bounds for minimax risk in the estimation problem.
منابع مشابه
REACT Scatterplot Smoothers: Superefficiency through Basis Economy
REACT estimators for the mean of a linear model involve three steps: transforming the model to a canonical form that provides an economical representation of the unknown mean vector, estimating the risks of a class of candidate linear shrinkage estimators, and adaptively selecting the candidate estimator that minimizes estimated risk. Applied to oneor higherway layouts, the REACT method generat...
متن کاملExtremal Fits in React Confidence Sets
REACT estimators use ideas from signal processing, model-selection, and shrinkage to achieve much smaller risk in one-way layouts and other linear models than does the classical least squares estimator. The REACT method can generate automatic scatterplot smoothers that compete well on standard data sets with the best fits obtained by other methods. This paper addresses two further questions: Wh...
متن کاملLinear or Nonlinear? Automatic Structure Discovery for Partially Linear Models.
Partially linear models provide a useful class of tools for modeling complex data by naturally incorporating a combination of linear and nonlinear effects within one framework. One key question in partially linear models is the choice of model structure, that is, how to decide which covariates are linear and which are nonlinear. This is a fundamental, yet largely unsolved problem for partially ...
متن کاملSlac Pub-3013 Stan-orion 003 July 1982 (ml Smoothing of Scatterplots*
A variable span scatterplot smoother based on local linear fits is described. Local cross-validation is used to estimate the optimal span as a function of abscissa value. A rejection rule is suggested to make the smoother resistant against outliers. Computationally efficient algorithms making use of updating formulas and corresponding FORTRAN subroutines are presented.
متن کاملAutomating the Creation of Interactive Glyph-supplemented Scatterplots for Visualizing Algorithm Results
Ndaona is a Matlab toolkit to create interactive three-dimensional models of data often found in NLP research, such as exploring the results of classification and dimensionality reduction algorithms. Such models are useful for teaching, presentations and exploratory research (such as showing where a classification algorithm makes mistakes). Ndaona includes embedding and graphics parameter estim...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1998